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Ahstrac*' 

An on-line ainioua variance parsaeter identi- 
fier is developed which embodies both accuracy 
and computational efficiency. The formulation re- 
sults in a linear estimation problem with both 
additive and multiplicative noise. The resulting 
filter which utilizes both the covariance of the 
parameter vector itself and the covariance of the 
error in identification is proven to be mean 
square convergent and mean square consistent. The 
MV parameter identification scheme is then used to 
construct a stable stete and parameter estimation 
algorithm. 


1. Introduction 

In designing adaptive control systems, it is 
necessary to determine whether to implement an 
explicit system in which on-line parameter identi- 
fier is needed or an implicit system which 
does not require explicit parameter identification. 
Recent studies have indicated preference for er- 
plicit designs whenever the process to be con- 
trolled has non-minimum phase characteristics 
and/or high gain and large bandwidth limita- 
tions. [1,2] 

The development of such an adaptive control 
system requires the use of an identification 
scheme that is capable of supplying parameter 
estimates at an accuracy and rate specified by the 
controller characteristics. Because a digital 
adaptive controller uses elements of the discret- 
ized matrices, identification of these elements 
and not the continuous physical system parameters 
should be considered. Furthermore, identification 
of the parameters of a continuous system (e.g., 
stability derivatives) from discrete data resiilts 
in a problem with many severe nonlinearities. 

linear system identification uslr.g the input 
and noisy measurements of the output cam be 
generally cast as a state estimation problem with 
both additive and multiple cst ion noise (AMN). 

These terms will in fact be functions of the same 
noise sequence. The continuous optimal nonlinear 
filter as derived by Kushner[3] for (A2'd) is 



infinite d<ii^nsionad and its physical realization 
is impossible. Approximate linear filters were 
subsequently derived for AMN[U,S] under the 
assumption that the additive ari multiplication 
disttirbance terms are functions of two independ- 
ent random processes; hence these results are not 
Isnediately applicable to system identification. 
Thus, a new on-line minimum variance tiller for 
the identification of systems with additive and 
multiplicative noise has been developed which 
embodies both accuracy and computational effici- 
ency. The resulting filter is shown to utilize 
both the covariance of the parameter vector 
itself and the covariance of the error in identi- 
fication. A bias reduction scheme can be used if 
desired, to yield asymptotically unbiased esti- 
nates . 

As common in deriving any estimation 
scheme, proof of the convergence of the identifi- 
cation filter is an integral part of the valida- 
tion of the results. In this respect, the pro- 
posed identification scheme is shown to be con- 
vergent in the mean square sense. The proof con- 
sists of deriving a suitable upper-bound for the 
mean square error (MSE) and showing that the MSE 
converges to zero as time tends to infinity. The 
mean square convergence of the filter implies coiw 
vergence with probability which, in turn, would 
imply that the estimates are consistent. Using 
the proposed parameter identification filter and 
the related convergence proofs, a state-parameter 
estimation scheme is constructed and proven to be 
stable in the sense of boundness. The resulting 
state-parameter scheme is shown to be computa- 
tionally feasible and amenable for on-line system 
identification and adaptive control applications. 

To illustrate the reliability of the identi- 
fication schemes and the problems encountered, 
experimental results for simulated linearized 
lateral aircraft notion in a digital closed loop 
mode, are included. A c''mparison of the extended 
Kalman filter and the ainisnim variance filter in 
the adaptive node are presented. 
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2 . Problen Dvflnitlon 

Th« problea of determislns on-lin* valuet of 
certain paraneters appearing in the discrete equa- 
tions of a linear constant coefficient process, 
which are beat with regard to use in adaptive 
control logic, given the input and noisy aeaaure- 
aents of the output, was considered using an 
on-line ainiaua variance filter. The correspond- 
ing equations are: 

x(k>D- A x(k) ♦ B u(k) (1) 

y(k) ■ x(k) ♦ n(k) (2) 

where 

x(k] * plant state at the k ° sample instant 
(n X 1) 

A * state transition matrix for the dis- 
crete system (n x n) 
u(k) » control vector (m x 1) 

3 ■ control distribution matrix (n x m) 

y(k) > measurement vector (A x 1} at the k 
instant 

n(k) > measvirement noise at the k instaunt 
covariance matrix S(i,J) • a* 6^^^, 

where ® otherwise. 

3. Parameter Modeling 


The identification problem as defined in (b) and 
(5) appears to be a conventional linear state 
estimation problem. However, because x is not 
known exactly, C and D are also unknown, and the 
rules and usage of the conventional Kalman filter 
cannot be applied. Substituting equation (2) 
into (5) gives: 

y(k+l)-n(k^l)wC(y(k)-n(k),u(k))q(k) 

♦ D(y(k)-n(k) ,u(k)) S (6a) 

where 

the notation C(y(k)-n(k), u(k}) and 
0(y(k)-n(k) ,u(k) ) stresses the fact that 
the selection matrices C and 0 are functions 
of the state and control values, noting 
that: 

C(y(k)-n(k),u(k))»C(y(k) ,u(k) )-C(n(k) ,u(k) ) 

and similarly for D, equation 6a can be 
rewritten as: 

y(k-*-l)-D(y(k),a(k))S-C(y(k),u(k))q(k) 

-c(n(k) ,u(k) )q(k)-D(n{k),u(k)}S+n(k+l) (6b) 
Defining 

z(k) - y(k^l) - D(y(k), u(k)) S 


To estimate any unknown vector of parameters 
q appearing in the state transition matrix A and 
in the control distribution matrix B, it is nec- 
essary to model the dynamics and observations of 
the system parameters. Furthermore, since not all 
parameters appearing in the i&atrices A and B are 
to be identified, the differentiation between the 
set of parameters that are to be identified and 
the set of parameters not to be identified is 
generally recommended. In particular, a conven- 
ient representation of the system is: 

x(k^l) ■ C(k) q(k) ♦ D(k) S (3) 

where 


C and D are selection matrices containing 
values of the system state and control at the 


k instant. A zero entry for a particular 
C, .(or D. ) would indicate that no coupling 

exists between x, and q (or between x, and 

•j)- ^ 

q is a vector of uziknown parameters appear- 
ing in the A and B matrices. 

3 is a vector of known parameters appearing 
in the A and 3 matrices. 


The model for the constamt deterministic or stoch- 
astic parameter vector q is then given by: 


Systems Dynamics 

q(kfl)»q{k),i(q(0) j-q^ 

PQ»E({q(0)-qg)(q(0)-qg)‘] 

Sbaef/ation 

x(k*l) » C(k) q(k) * D(k) 3 


(M 

(5) 


to be a pseudo-measurement vector for the linear 
system given in (U) and rearranging equation (7) 
gives the parameter model: 

q(k+l) ■ q(k) 
z(k)»C(k)q(k)-C^(k)q(k) 
tTi(k^l)-D^(k)S 

where 

C(k) » C(y(k), u(k)) 

c (k) a c(n(k), u(k)) 
n 

D^(k) a D(n(k), u(k)) 

Equations (7) and (8) denote a linear time in- 
variant system with a transition matrix I and 
observation matrix C(k). The observation is 
corrupted by the multiplicative noise term C (k) 
and the additive noise terms n(k)-D_(k)S ^ 

with covariance S ap+E (D^S 3* D_‘} 
eq n n 


(7) 

( 8 ) 


h. Minimum Variance Estimation 
i*.l Development 

Because of divergence and/or inaccuracies 
common to most existing identification schemes, 
it was desirable to develop an alternate scheme 
that could hopefully deal with these problems. 
The proposed filter is based on a minimum var- 
iance performance index for the state estimation 
of a linear system with additive and multiplica- 
tive noise. 


2 



The optisium ainlBum varlaacc filter for a 
continuous system Is In fact nonlinear [3], and 
Its exact ijspleaentatlon Is virtually impossible. 
A linear optimal filter was therefore of Interest. 
Thus defining the Identification algorithm to he 

$(k)-q(k-l)'HC(k)(t(k)-C(k-l)a(lt-t)I (9) 


the error q and the noise selection 
matrix C will not vanish; this can he 

n 

Illustrated hy noting that: 
E{C^(k-l)q(k)q'^(k-l)|yg,...y(k)} # 0 (15) 

5 . Bias Reduction 


K is to he determined so as to minimize: 

J- py(c^(k) - ^(k))2 (10) 

which Is the trace of the covariance matrix 

P(k)-Ey{(q(k)-q(k) )(q(k)-4(k) )^} (U) 

where Ey(a(k))-E[<»ly(0),...y(k)] 

The parameter I (which will he discussed In the 
next section) defines the frequency of identifica- 
tion. Define the parameter error as q(k)=q(k)- 
-q(k), with initial conditions at T>0 

E(q(0))-0 ; E{q(0) q(0)^} 

using (7), (3) and (9) the error q propagates as: 

q(k)-q(k-l)+K(k)[-C(k-l)q(k-l) 


Although the linear minimum varir^ce filter 
as described hy equations (9)t (l^) vid (15) was 
observed to be relatively accurate with respect 
to other linear schemes, a substantial hie > did 
appear In the parameter estimates, especially In 
the estimates of Insensitive parameters [2]. An 
investigation was therefore conducted to determine 
the causes and the means to reduce or eliminate 
the bias. 


By combining equations (15 and (lU), the gain 
can be rewritten as: 


K(k)-P(k)c'^(k-1)R "^(k-1) (l6a) 

(1) 

where 


R «R 
(j) eq 


k-1 


(I6b) 


By substituting (l6) In (9) and taking the expec- 
tation and the limit as K -> *, It is found that ‘ 


-C„(k-l)q(’i)-D„(k)S+n(k)] (12) 

0 n 

By post multiplying 12 by its transpose, and tak- 
ing the conditional expectation over the entire 
measurement vector history (y(0) , . . .y(k) ) and 
noting that: 

E[C^(k-l)q(k)q'^(k-l) |yg, . . .y(k) ]=0 

when t > 1, the difference equation for the condi- 
tional variance P(k) becomes: 

?(k)=P(k-l)-K(k)C(k-l)P(k-l)-i^(k-A)C^(k-l)K^(k) 

>S(k)(C(k-l)P(k-l)c'^(k-l)*w(k-l)+R )K^(k) (13a) 

e<l 

Where 

U|^-j^»E{C^(k-l)q(k-l)q"(k-4)C^(k-l)} (l3b) 

Stationary conditions for the minimization of the 
trace of P(k) are obtained by setting all deriva- 
tives of (12) with respect to the elements of K(k) 
equal to zero. This yields: 

:<(k)»P(k-l)c'^(k-l)[C(!c-l)?(k-l)c’^(k-l) 

+t)(k-l)+a (lU) 

eq 

4.2 Observations 

(1) The gain of the resulting filter is a 
function of the error covariance ? and 
the weighted noise covariance u)(13b); 
where the weighting matrix for u) is the 
covariance of the identified parameter q. 

(2) The derivation of the proposed minimum 
variance filter is made possibly by not 
identifying every sample; i.e., i > 1. 

For i “ 1, the expected value of many 
cross terms Involving the parameter q. 


S{q(k)}»[E{C^(k-l)R’^ C(k-l)}tE{r(k-l)R~^ 

U) II 0) 

C (k-1)}]'^ • [E(c'^(k-l)R‘^C(k-l)}] • q(k)(l7) 

n u) 

Obviously equation (17) reveals the bias in the 
estimates of q, q. Assumiiig that the term 

/ V *1^ § \ 1 

E{C (k-l)R C(k-1)> is a generalized measure of 
n 41 m 

the signal power, and E(C^(k-l)R^ ^ 

generalized measure of the noise, equation (17) 
can be written as: 

E{q(k)}-[S + [S] • q(k) (l8) 

where 

3 * E(c'^(k-1)R"^ C(k-l)} 

* u) 

N ■ E{C*(k-l)R"^ C (k-1)} 

■" n 0 ) n 

3y examining equation (17) and (l8), it be- 
comes obvious that the troublesome term is the 
noise power .Hence a correction term must be 
added so as to compensate for the bias. From 
consideration or equations (1^) and (17), it is 
clear that the correction term must incorporate 

the covariance tenn ?, and the latest estimate 
k 

q^^ Adding the correction term to (lU), the 
basic algorithm becomes: 

q(k)-{I+P(k) 7(k)}q(k-l) 

+ K(k) [z(k)-C(k-:' q(k-D] 119) 

where (3(k) is to be found sv.ch that 

Urn S{q(k)} «q (20) 

k-«» 


TaJclng the expectation for (19) and using (20), 
yields: 

0 ( k ) «E { ( k-1 ) R"^C„ (k-1 ) } -N 

n 0) n 

Hence, the modified mlnloum variance filter Is 
given by: 

q(k)«(I+P(k)E(C^(k-l)R"^ C (k-l)} )q(k-t) 

n ui n 

♦ K(k)[z(k)-C(k-l)q(k-l)l (21) 

where P(k) and K(k) are given by the recursive equ 
equations (lU) and (15)* It should be pointed out 
that in recursive on-Mne parameter identification 
schemes, only asymptot'^c unbiasness is possible[6]. 

6. Filter Stability 

Essential to any estimation scheme is the 
validity of the resulting estimates. In this 
respect, it is desired to prove that the proposed 
Identification algorithm converges to the actual 
system pakrameters. The convergence of the filter 
is of particular importance since the resulting 
estimates are to be used in the construction of 
an adaptive controller. Before proceeding in 
establishing the convergence of the proposed iden- 
tification scheme, the following assumptions needed 
for the proof are stated: 

Al. [ri ] is a vector sequence '^diose entries 
are zero mean Independent variables. All 
entries of the measurement noise vector 
(n. ) are mutually independent. Second 
ana fourth moments of are uniformly 
bounded. 

A2. The deterministic control vector u(k) is 
assumed to be bounded. Similarly the out- 
put vector y(k) and all transformations on 
y(k) are assumed to have bounded moments. 

A3. The linear system is completely control- 
able and completely observable. 

Al*. The parameter sat to be identified is 
assumed to be completely observable [7l 
In the sense that the information matrix 



is positive definite. 

A5. The product of the matrix P and the sig- 
nal power S is positive definite. 

6.1 Parameter Filter Tonvergence 

Theorem 1 . Mean Square Convergence . Under the 
assumptions Al to \ 5 , the linear estimator of 
q(k) given in equations ll*, 15 and 21 converges 
in the mean square sense to the unknown parameter 
vector q of the linear system in (1-2). 


Proof: The estimation error q can be given by the 
following equation: 

q(k)w(I>P N-PC’^(1-1)R"^ C(k-l)]q(k-o) 

♦P[c’^(k-l)R“^C(k-l)q-»q 

-c’^(k-l)R"^C(k-l)q-c''(k-l)R~^(n-D S)] (22) 

uj U) f| 

Premultiplying (22) by q(k), taking the expecta- 
tion and by repeated use of the Cauchy-Shwartz and 
triangle inequalities, an upper bound for the 
mean square of the identification error can be 
established. [8] By applying Venter's Theorem [9] 
and using the fact that in the limit, the maximum 
eigenvalue of P behaves as ^ , the mean square 

error E[||q(k)||*] is shown to converge to zero 
in the limit, l.e. , 


Um E[||q(k)||*] » 0 
It** 

Combining the fact that the proposed identifica- 
tion scheme is asymptotically unbiased and mean 
square convergent, it is concluded that the filter 
is mean-square consistent. 

6.2 Convergence of State Estimation 

The maximum likelihood, minimum variance and 
least squares estimate of the state vector x(k) 
given the measurement vector y(0i....y(k) is 
given by the Ksdman-Bucy filter* The Kalman 

filter was shown to converge in the mean square 
sense and with probability 1 if the plant model 
and Gaussian noise statistics are exactly known. 

In cases where the plant model is not exactly 
known, an approximate Kalman filter can be con- 
structed using identified parameters. The stabil- 
ity of the approximate Kalman filter is discussed 
in the sequel. 

Theorem 2 : Given the approximate Kalman filter 

x(k/k)-A x(k-l/k-l)+B u(k-l) 

♦Kg(k)(y(k)-(A x(k-l/k-l)+B u(k-l)]] 

K^(k)>P^(k)R-^ (23) 

where x(k/k)d state estimate using identified 
parameters 

A , 3 identified system and input 

matrix 

, Pg gain and covariance matrix uslr.g 
identified parameters, 

if the linear system (1,2) is stable and if A and 
3 are consistent estimates of A and 3 respectively, 
then 

lim ^ T|x(k|k)-x(k|k)|»0 with probability one 

ll ** 

P (k) - P° as k » with orobability one 
ic (k) -► K® as k -» o» with probability one 

S3 • V 
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where 

x(k|lc)4 optiaal state estimate 

!C^ , ■ optiaal gain and covariance matrix 

The proof of theorem 2 is provided in reference 

(3 ). 

It was shown in section 6.1 that the esti- 
mator 4 in (21) is mean square convergent and mean 
square consistent. By invoking theorem 2 and the 
stability condition on the plant in 1, it can be 
observed that the proposed identifier and the 
respective approximate Kalman filter constitute a 
stable (in the sense of boundedness) state- 
parameter identification scheme. This structure 
can serve as an alternative to the linearized 
Kalman filter with the advantages of stability and 
ease of implementation. Simulations for the state 
parameter filter are presented in section 8. 

T. Identification of Time Varying Parameters 

Modeling time varying parameters as a first 
order random walk, the minimum variance filter can 
be modifie d or rederived so as to truk the varla-_ 
.tions ip t he avst em parameter qLkl. The. aew oarar . 
meter model is then given by the following equa- 
tion: 

Parameter Model 

q(k) « q(k-l) + v(k-t) (2U) 

where v is a zero mean uncorrelated stationary 
Oausslan noise sequence with covariance 
Q(k) - SMk) v(k)T}. 

Since the parameter vector q is modeled a 
first order random walk, its covariance has to be 
updated recursively so as to compute w(k-l). 
Assuming that the initial parameter covariance T 
is given by: 

T(0) - E{q(0) q^(0)}; 

the parameter covariance T(k) and the weighted 
noise covariauice are given by [3]: 

T{k) - T(k-0 t Q(k-i) (25) 

u(k-l)-E{C (k-l)T(k-l)c3(k-i) ( 26 ) 

Equations (25) , (26) s-nmnarize the minimum var- 
iance filter for identification of varying para- 
meters. The resulting filter is relatively 
simple for use in a typical process control 
computer. 

3. Applications and Results 

The performance of the minimum variance fil- 
ter was evaluated experimentally using an adap- 
tive controller designed for the linearized 
lateral motion of a typical fighter alrcraft(lO 1 . 

In particular feedforward gains were updated 
by direct formula evaluation, while a Hiccatl 
type iterative procedure was used to update the 
feedback gains. 


For evaluation purposes, the aircraft was 
assumed to be flying in a fixed flight condition 
(FC2, Mach 0.9, 3000 m). A sensitivity study de- 
fined, for identification, a set of 12 parameters 
which make up the first and third rows of A and B 
matrices . Parameter estimates were obtained 
every other sample (t"2) using noisy measurements 
of the states (2) and us ed eve ry 1 sec, in the 
gain adaptation procedure . The resulting para- 
meters and gains were then used to estimate the 
states and controls each sample period of 0.2 sec. 

The ,*duare wave aileron pilot input u of 5° at 

& 

the frequency of O.U Hz was used in all the 
experiments. 

The convergence properties, adaptive con- 
troller results and comparisons with different 
identification procedures to be presented in this 
paper were all conducted for FC2 and all para- 
meter estimates were initialized at 50S of their 
actual values. 

Figures l.a,b, and c illustrate the behavior 
using the minimum variance filter. The asymptotic 
unblasness is evident in figures l.a and c which 
show that the estimates have converged within 
20 sec. (50 measurements). The parameter a^^^ 

featured in figure l.b is very insensitive espec- 
ially with aileron excitation (the parameter a^. 
couples the sideslip angle to the roll rate). 

Figure 2 depicts the roll rate behavior in 
the adaptive mode. It can be seen that model 
following performance is highly correlated with 
convergence of the parameter estimates. Reason- 
able model foUowi.ng was achieved after 15 sec. 
when most parameters had converged to the actual 
values. Comparative results using the ELF are 
shown in Fig. 3. 

9. Discussions and Conclusions 

A linear minimum variance parameter identifi- 
er was derived and was shown experimentally to 
converge to the actual parameters. A bias reduc- 
tion scheme and modifications for time varying 
parameters were presented. The new filter proved 
superior over existing linear and linearized para- 
meter filters and generally more flexible and 
effective in the estimation of insensitive para- 
meters . 
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